SPECIFICATION 



TO ALL WHOM IT MAY CONCERN: 

BE IT KNOWN THAT WE, HIROYUKI SAKUYAMA, a 
citizen of Japan residing at Tokyo, Japan, AKIRA 
TAKAHASHI, a citizen of Japan residing at Kanagawa , 
Japan, TAKAO INOUE, a citizen of Japan residing at 
Kanagawa, Japan, TAKANORI YANO, a citizen of Japan 
residing at Kanagawa, Japan, TAKASHI MAKI , a citizen 
of Japan residing at Kanagawa, Japan, KEIICHI IKEBE, 
a citizen of Japan residing at Kanagawa, Japan, TAKU 
KODAMA, a citizen of Japan residing at Kanagawa, Japan 
and IKUKO YAMASHIRO, a citizen of Japan residing at 
Kanagawa, Japan have invented certain new and useful 
improvements in 

IMAGE RECORDING APPARATUS AND IMAGE DATA SELECTION 

METHOD 

of which the following is a specification:- 



BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention generally relates to 
an image recording apparatus such as an electronic 
5 camera for recording image data to a recording medium, 
and more particularly, a technology for securing 
unused capacity of the recording medium of the image 
recording apparatus . 

10 2. Description of the Related Art 

Generally in a case where an electronic 
camera apparatus such as a digital still camera is 
short of an unused capacity of a recording medium, 
image data that are recorded to the recording medium 

15 are erased so as to secure additional unused capacity 
of a recording medium. Erasing the image data can be 
performed by selecting individual pieces of the image 
data or selecting all of the image data. However, in 
a case of selecting individual pieces of the image 

20 data, the procedure is complicated. In a case of 
selecting all of the image data, although the 
procedure is not complicated, there is a disadvantage 
in that some image data desired to be retained cannot 
be stored. 

25 In order to erase the image data that are 
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recorded more efficiently and store the image data 
desired to be stored, the following technology is 
described in Japanese Laid-Open Patent Application, 
No. 2002-44601. That is, image data consisting of 
5 correlated image data such as image data taken 

consecutively, image data blanket-photographed, and 
image data panorama-photographed, are managed as a 
group. Furthermore, image data desired to be stored 
are protect-designated . Because of this, if image 

10 data belonging to a group are selected and ordered to 
be erased, other image data belonging to the same 
group, except image data that are protect-designated, 
are erased together. 

Alternatively, there is another technology 

15 wherein image data that are recorded are not erased 
but the amount of the image data is reduced so that 
additional unused capacity of the recording medium is 
secured . 

For example, Japanese Laid-Open Patent 
20 Application No. 8-9312 discloses a technology wherein 
selected image data are recompressed at a higher 
compression ratio, or a part of the image data is 
trimmed so that the amount of data is reduced. 
Japanese Laid-Open Patent Application No. 2001-320588 
25 discloses a technology wherein a coded method having 
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a multiple layer structure is applied and code data 
are reduced at a layer unit so that the amount of the 
image data is reduced. Japanese Laid-Open Patent 
Application No. 2001-231009 discloses image data that 
5 are recorded are recompressed and codes of a part of 
the code data are deleted so that the amount of the 
data is reduced and additional unused capacity 
corresponding to deleted pieces of recording image 
can be secured. In this technology, furthermore, the 

10 compression ratio of new image data is controlled so 
as to correspond to the additional unused capacity 
secured by reducing the amount of the data. 

Japanese Patent No. 3229144 discloses a 
technology regarding control of the compression ratio 

15 of new image data wherein the control is 

automatically switched to an intermediate precision 
mode having a higher compression ratio when there is 
a lack of the unused capacity at a high precision 
mode . 

20 Japanese Laid-Open Patent Application No. 

2001-218062 discloses a technology of a system for 
managing a radiation image wherein the amount of data 
is reduced by a combination of deletion of a code in 
a non-interest area of image data that are stored, 

25 and recompression. In addition, Japanese Laid-Open 



Patent Application No. 2001-309138 discloses a 
technology of a copying machine in that color image 
data are transformed to black-and white image data so 
that the amount of the data is reduced. 
5 A method wherein the amount of image data 

that is recorded is reduced so that additional unused 
capacity of the recording medium can be secured has 
an advantage as compared with a method for erasing 
image data in that image data desired to be stored 

10 are not erased completely. However, the selection of 
image data to have the recorded amount reduced 
depends on the user. The Japanese Patent Laid-Open 
Patent Application No. 2001-231009 merely discloses 
selecting image data having a maximum amount of 

15 recorded data. 

SUMMARY OF THE INVENTION 

Accordingly, it is a general object of the 
present invention to provide a novel and useful image 
20 recording apparatus and an image data selection 

method in which one or more of the problems described 
above are eliminated. 

Another and more specific object of the 
present invention is to provide an image recording 
25 apparatus such as an electronic camera apparatus 
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whereby image data are selected more rationally and 
the amount of data can be reduced without troubling 
the user (photographer) so as to obtain satisfaction 
of the user. 

5 The most important thing regarding automatic 

performance of a process of data amount reduction of 
image data that are recorded is whether or not the 
user (photographer) can accept deterioration of image 
quality. Hence, in order to obtain high satisfaction 

10 of the user (photographer) , it is preferable that 

image data on which a data amount reduction process 
is performed can be selected with consideration of 
image quality. Furthermore, it is important for 
obtaining the high satisfaction of the user 

15 (photographer) to reflect use's (photographer's) will 
or taste. 

The above objects of the present invention 
are achieved by an image recording apparatus, 
including: means for recording image data in a 

20 recording medium; means for obtaining information for 
determining a data amount reduction remaining force 
of image data recorded in the recording medium; means 
for selecting image data determined to have a large 
data amount reduction remaining force based on the 

25 information obtained by the means for obtaining 



information, with a priority; and means for 
performing a data amount reduction process against 
the image data selected by the means for selecting. 

The above objects of the present invention 
are also achieved by an image data selection method 
for selecting image data on which a data amount 
reduction process is performed from image data 
recorded in a recording medium, comprising the steps 
of : a) obtaining information for determining a data 
amount reduction remaining force of image data; and 
b) selecting image data determined to have a large 
data amount reduction remaining force, based on the 
information obtained in the step a), by a criterion, 
with a priority. 

Other objects, features, and advantages of 
the present invention will become more apparent from 
the following detailed description when read in 
conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram for explaining an 
embodiment of the present invention; 

FIG. 2 is a view for explaining two- 
dimensional wavelet transform; and 

FIG. 3 is a view for explaining a code data 
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structure created by an image compression/elongation 
part; 

FIG. 4 is a flow chart for explaining an 
operation at the time of taking a still picture; 
5 FIG. 5 is a flow chart for explaining an 

operation wherein a data amount reduction process 
performed on image data that are recorded is 
automatically performed; 

FIG. 6 is a flow chart for explaining an 
10 operation at the time of taking a motion picture; 

FIG. 7 is a flow chart for explaining an 
operation wherein a data amount reduction process 
performed on image data that are recorded is 
performed by an operator; 
15 FIG. 8 is a flow chart for explaining an 

operation whereby various designations are performed 
on image data that are recorded; 

FIG. 9 shows contents of a main header shown 
in FIG. 3 handled by the embodiment of the present 
20 invention; 

FIG. 10 shows a configuration of a QCD 
marker shown in FIG. 9; 

FIG. 11 shows quantization default parameter 
values of QCD marker segment shown in FIG. 10; 
25 FIG. 12 shows quantization default values 
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for the Sqcd and Sqcc parameters; 

FIG. 13 shows reversible step size values 
for the SPqcd and SPqcc parameters (reversible 
transform only) ; 
5 FIG. 14 shows quantization values for the 

SPqcd and SPqcc parameters (irreversible 
transformation only) ; 

FIG. 15 illustrates terms according to 
JPEG2000 and; 

10 FIGS. 16A, 16B and 16C illustrate concepts 

of layer and packet in conjunction with a bitplane 
coding scheme according to JPEG2000. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
15 A description is given below, with reference 

to the drawings, of embodiments of the present 
invention . 

FIG. 1 is a block diagram for explaining an 
embodiment of the present invention. In this 

20 embodiment, an electronic camera, by which a still 
picture and a motion picture of a subject to be 
photographed is taken with picture means, a frame 
picture image of the still picture and the motion 
picture is input, and image data of the frame picture 

25 image are recorded to a recording medium, is used. 
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Although a so called digital still camera whose main 
function is taking the still picture is explained as 
the electronic camera in this specification, the 
inventor of the present invention does not have any 
5 intention to exclude a so called digital video camera 
whose main function is taking the motion pictures . 
The present invention can be applied to the entire 
image recording apparatus by which image data of a 
still picture or a motion picture is input from an 

10 apparatus such as a personal computer or an optical 
disk apparatus, a network, or the like, and recorded 
to a recording medium. Furthermore, an image data 
selection method of the present invention is 
described in this embodiment. 

15 Referring to FIG. 1, picture means 100 (more 

specifically image input means) include a picture 
optical system 102, an image sensor 104, an analog 
signal processing part 106, an analog/digital 
transform part 108, an image processor 110, a memory 

20 114, a displaying apparatus 112, an operation part 
124, and a system controller 122. An optical image 
of a subject to be photographed is formed at the 
image sensor 104 by the picture optical system 102 so 
as to be transformed into an electric signal. The 

25 picture optical system 102 includes an optical lens, 
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an iris mechanism, a shutter mechanism, and the like. 
The image sensor 104 performs a color separation of 
the formed optical image by a color filter and 
outputs an image signal corresponding to the amount 
5 of light of respective color components. Generally, 
a CCD type image sensor or a MOS type image sensor is 
used as the image sensor 104. 

The image signal output from the image 
sensor 104 is treated by a process of correlated 

10 double sampling, gamma correction, white balance 
adjustment, and the like by the analog signal 
processing part 106, and then transformed to digital 
image data by the analog/digital transform part 108 
so as to be input to the image processor 110. The 

15 image processor 110 performs imaging processing such 
as an edge enhancement process on image data, 
controls the image sensor 104, the analog signal 
processing part 106, the analog/digital transform 
part 108, and the displaying apparatus 112, and 

20 detects information for auto focus control, automatic 
exposure control, and the like. The image processor 
110 includes the memory 114 for temporarily storing 
image data having more than one frame. The 
displaying apparatus 112 is a liquid crystal 

25 displaying apparatus, for example. The displaying 
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apparatus 112 is used for displaying a photographed 
image (a through image) at the time of monitoring, a 
recording image, and various kinds of information. 
The processes such as gamma correction and the white 
5 balance adjustment may be treated by the image 
processor 110 as a modified embodiment. This 
modified embodiment is included in the present 
invention . 

A system controller 122 responds to 

10 operation information input from an operation part 

124 and information given by the image processor 110, 
and performs control regarding the picture means 100 
such as control of the shutter mechanism, the iris 
mechanism, and the zooming mechanism of the picture 

15 optical means 102 and control of the image processor 
110. In addition, the system controller 122, as 
described below, performs a control regarding 
compression/elongation and recording/reading out of 
the image data, reduction of the amount of recorded 

20 image data, and the like. 

The image data photographed (input) by the 
picture means 100 is compressed and then recorded to 
a recording medium 170 such as a memory card, as an 
image file having a designated file format. An image 

25 compression/elongation part 150 is provided for 
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compressing and elongating such image data. A file 
managing part 166 is provided for recording the 
compressed image data to the recording medium 170 and 
reading out the recorded image data. Recording or 
5 reading out the image file is performed via an 
interface part 168 based on control of the file 
managing part. Furthermore, in the present invention, 
a reduction process of the amount of the recorded 
image data is performed. A data amount reduction 

10 managing part 162 is provided for managing the above 
mentioned process and selecting image data that are 
subject to be processed. A management information 
storing part 164 is provided for storing information 
related to the reduction process of the amount of the 

15 data and recording/reading out process of the image 
file. The entire operation related to the 
compression/elongation of the image data, 
recording/reading out the image data, and data amount 
reduction of the recorded image data is controlled by 

20 the system controller 122. 

Although it is preferable for the image 
compression/elongation part 150 to have a structure 
wherein an image compression algorithm by which the 
amount of data can be adjusted with an operation of 

25 code data and without recompression of image data is 
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used, an image compression algorithm requiring 
recompression may be used. In this embodiment, the 
image compression/elongation part 150 has a structure 
wherein an image compression algorithm in conformity 
5 to JPEG2000 is used. The image 

compression/elongation part 150 includes a DC level 
and color space transform part 152, a two dimensional 
wavelet transform part 154, a quantize part 156, an 
entropy coding part 158, and a code generation part 
10 160. 

An operation for standardizing a basic form 
(JPEG2000 Part 1) of JPEG2000 was completed so that 
JPEG2000 was recommended in January 2001. A 
recommendation of Motion JPEG2000 (JPEG2000 Part 3) 

15 that is an expanded form of JPEG2000 is close at hand. 
The Motion JPEG2000 handles a motion picture as a 
series of still pictures. A compression algorithm of 
the Motion JPEG2000 for respective frame images is 
the same as the basic form of JPEG2000. The 

20 difference between the basic form of JPEG2000 and the 
Motion JPEG2000 is only a partial difference of file 
format. Details of the image compression algorithm 
of the JPEG2000 are, for example, described in a 
publication "Next generation image code method 

25 JPEG2000" written by Nomizu Tadayuki and published by 
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Triceps . A schematic explanation thereof as follows. 

Image data that are subjects of a 
compression process, respective image data in a case 
where" the motion picture is handled, are divided into 
5 non-overlapped rectangular areas called tiles for 
every component, so that the image data are input 
into the DC level and color space transform part 152. 

In order to improve the compression ratio, a 
level shift operation and a color space transform 

10 process are performed at the DC level and color space 
transform part 152. The level shift operation is an 
operation for subtracting a half of the dynamic range 
from an integer value not having a code such as an 
RGB value. In a case where the input image data are 

15 YCrCb data, for example, the level shift operation is 
not performed against an integer value having a code 
such as a Cr or Cb component. The color space 
transform process is a process for transforming YCrCb 
data in a case where the input image data are RGB 

20 data or CMY data. The DC level transform and the 

color space transform may be performed by the image 
processor 110 . 

After being processed by the DC level and 
color space transform part 152, the image data of the 

25 respective tiles of the respective components are 
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processed by a two-dimensional wavelet transform 
(Discrete Wavelet Transform: DWT) by the two- 
dimensional wavelet transform part 154. 

FIG. 2 is a view for explaining a two- 
5 dimensional wavelet transform in a case where the 
decomposition level number is 3 (three) . By 
performing the two-dimensional wavelet transform on a 
tile image OLL shown in FIG. 2- (a) , the tile image is 
divided into respective sub-bands of ILL, 1HL , 1LH 

10 and 1HH as shown in FIG. 2- (b) . By applying the two- 
dimensional wavelet transform to the coefficient of 
ILL sub-band coefficients, ILL is divided into sub- 
bands of 2LL , 2HL, 2LH, and 2HH as shown in FIG. 2- 
(c) . By applying the two-dimensional wavelet 

15 transform to the coefficient of 2LL sub-band 

coefficients, 2LL is divided into sub-bands of 3LL, 
3HL, 3LH, and 3HH as shown in FIG. 2- (d) . 

Coefficients of the respective sub-bands, 
obtained by a recursive division (octave division) of 

20 such low freguency components (LL sub-band 

coefficients) , are quantized by the quantize part 156 
and then coded by the entropy coding part 158. 
JPEG2000 can perform a reversible compression 
(lossless compression) and irreversible compression 

25 (lossy compression) . In the case of the reversible 
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compression , the quantizing step width is always 1 
(one) and quantizing is not substantially performed 
in this stage. 

The entropy coding part 158 performs entropy 
5 coding of the wavelet coefficients. For the entropy 
coding, a bitplane code method based on a block, 
called EBCOT (Embedded Block Coding with Optimized 
Truncation) is used. EBCOT consists of a block 
division, coefficient modeling, and binary algebraic 

10 coding. The wavelet coefficient that is subject to 
coding is an integer having a positive code or a 
negative code. The wavelet coefficients are scanned 
in a designated order, and a coding process is 
performed on the wavelet coefficients whose 

15. coefficients are expressed as an absolute values, 

from an upper bit to a lower bit for every bitplane 
unit . 

A code line generated by the entropy coding 
part 158 is sent to the code generation part 160. 
20 The code line that is algebraically-coded is arranged 
so as to reform in order required at the end, and a 
part of the codes are deleted (post-quantized) if 
necessary so that one bit stream is output. 

Code data (compression data) output by the 
25 image compression/elongation part 150 has a structure 
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shown in FIG . 3 . 

As shown in FIG. 3, in the code data, a SOC 
marker starts is first, a main header follows and 
then data of all respective tiles follow. In the 
5 main header, a parameter of coding, a parameter of 

quantizing, or the like is described. In the data of 
the respective tiles, a SOT marker is first. The 
data of the respective tiles include a tile header, a 
SOD marker, and tile data (code line) . After the 

10 last tile data, an EOC marker representing the ending 
is provided. 

The image compression algorithm of JPEG2000 
produces high quality images at a high compression 
ratio (low bit rate) and has a lot of favorable 

15 characteristics. One example of the characteristics 
of JPEG2000 is quantizing (post-quantizing) based on 
deletion (truncation) of a code of the lower bitplane 
after coding is performed. Because of this, the 
amount of all of codes, namely the compression ratio, 

20 can be adjusted without recompressing . In JPEG2000, 
the bitplanes of the coefficients are put in order 
using code block units or precinct units so as to 
form a layer comprising any number of bitplanes. In 
a case where a plural layer structure is applied, it 

25 is possible to perform to post-quantizing with a 
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layer ■ unit from the lower layer. 

An elongation process of the code data is an 
opposite process to the compression process of the 
code data. Tag information of the code data is 
5 implemented by the code generation part 160. The 
code data are analyzed into code lines of the 
respective tiles of the respective components . This 
code line is decoded to a wavelet coefficients in 
order based on the tag information by the entropy 

10 coding part 158. The wavelet coefficients that are 

decoded are treated reverse-quantized by the quantize 
part 156, and then subjected to two-dimensional 
wavelet reverse- trans form by the two-dimensional 
wavelet transform part 154. As a result of this, 

15 images of the respective tiles of the respective 
components are reproduced. The respective tile 
images of the respective components are subjected to 
transform process opposite. to the process at the time 
of compression by the DC level and color space 

20 transform part 152, and then output. The respective 
tile images of the respective components are combined 
by the image processor 110 so that the compressed 
image can be reconstructed. 

Since JPEG2000 adopts a bitplane coding, an 

25 encoder has to estimate the maximum value of wavelet 
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coefficients and translate the maximum value into the 
maximum number of bitplanes which have to be coded. 
This maximum number of bitplanes can be read from the 
codestreams as follows: 
5 FIG. 9 shows the contents of the main header 

shown in FIG. 3, which contains a QCD and a QCC, 
according to JPEG2000. 

The construction of a QCD marker segment is 
shown in FIG. 10, and * eb ' and a guard bit can be 
10 read from an SPqcd. In this regard, also see FIGS. 
11-14. 

When an image contains multi-components and 
the codestream has a QCC marker segment, 'eb' 
corresponding to each component can be read from an 

15 SPqcc in the QCC marker. 

Along the transformation, a wavelet 
transform increases the bits of coefficients and the 
amount of increased bits are different among HL, LH, 
and HH subbands according to JPEG2000. In the 

20 increased bits, the common amount of bits for each 

subband is treated as a guard bit, and the difference 
among the subbands are called "gain bits 1 ' for the 
convenience here. The amount of "gain bits" are 
independent of decomposition level (how many wavelet 

25 transform processes are done) and are specified in 
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the standard as 0, 1, 



1, 



2 for LL, HL , LH , HH , 



respectively . 



1 eb' is calculated during encoding, and when 



5x3 wavelet is applied, it is given by the following 
5 equation : 

(bits of original image) + (gain bits) + 
(increased bits by component transform) 

= Rb + (increased bits by component 

10 transform) 

It should be noted that the reversible component 
transform increases the bits like wavelet transform. 



15 the Ab (quantization step size) in the following 
equation and |ib shown in FIG. 14: 



As for 9x7 wavelet, * eb ' (= sb) is given by 




20 



Here again, 

Rb = (bits of original image) + (gain bits) 
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As for 5x3, which does not adopt 
quantization, Ab is regarded as 1. 

Using the equations shown above, the maximum 
number of bitplanes is given as follows, which is 
5 common between the 5x3 and 9x7 wavelet schemes: 



(the maximum number of bitplanes) = (bits of 
original image) + (gain bits) + (increased bits by 
component transform) - (decreased bits by 
10 quantization -1) 

= eb + guard bit - 1 (Eq.MBP) 
(-1 in the above equation is due to the DC level 
shift adopted in JPEG2000.) 

Next, the definition of number of zero 
15 bitplanes, number of coded bitplanes, and how to read 
them form codestream will be shown. 

Eq MBP above gives the maximum number of 
bitplanes in the subband, but it is natural that each 
codeblock in the subband does not always have the 
20 corresponding number of bitplanes (corresponding 

value of coefficients) to be coded. Some codeblocks 
have only zero values in most significant bitplanes, 
which should not be coded (in the same way as least 
significant bitplanes) . 
25 Then, for each codeblock, the number of zero 
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bitplanes is defined as follows: 

(the number of zero bitplanes) = (the number of 
maximum bitplanes) - (the number of actual bitplanes 
5 to be coded) . 



10 



The number of zero bitplanes for each 

codeblock can be read from the packet header. The 

following figures show the construction of tile data 

which comprises packet data, and the packet data 
comprises packet header and packet data. 



INTERNAL CONFIGURATION OF TILE DATA 



PACKET PACKET PACKET PACKET 
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INTERNAL CONFIGURATION OF EACH PACKET 



PACKET 


PACKET DATA 


HEADER 





The packet header contains the following contents, 



The packets have headers with the following rafonnatoqn: 

— Zero length packgl 

— C^e^ Week inclusion 

— Zero !>it« plane information 

— Number of coins passes 

— Length of the code* jlock comprised image data from a mm code* block 

which mean, respectively: 

- whether the packet is empty or not 
(whether the packet has no coded bitplanes or not) ; 

- how many codeblocks the packet contains; 

- the number of zero bitplanes for each 
codeblock included in this packet; 

the number of coded subbitplanes (=coding 
passes) for each codeblock included and coded in this 
packet; and 

- the length of entropy code for each 
codeblock included and coded in this packet. 

Then, the number of zero bitplanes for each 
codeblock is given by referring to the packet header. 
And using the above-mentioned Eq.MBP, the number of 
non-zero bitplanes for each codeblock is given. And 
referring to the packet header, the number of coded 
subbitplanes for each codeblock in the packet can be 
read directly, which can be translated into the 
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number of coded bitplanes for each codeblock. 

It: is noted that when the codestream has 
multiple layers, one codeblock is coded in multiple 
layers. For example, when 9 bitplanes should be 
5 coded, it is possible that the packet in a layer A 
has 5 coded bitplanes and a layer B has 4 coded 
bitplanes, for example. When calculating the coded 
bitplanes for a codeblock, the number should be 
summed for all layers . 
10 Usually, a subbitplane is an imaginary 

division of one bitplane, and one bitplane is divided 
into 3 subbitplanes for example. Most significant 
non-zero bitplane is not divided into subbitplanes 
exceptionally . 

15 As for the definition of codeblock, packet, 

layer and subband gain, a description will now be 
made. A coding process in JPEG2000 is performed in 
the following sequence: 

Wavelet transform of tile — > Quantization of 

20 coefficient of each subband -> Bitplane coding of each 
codeblock — > Assemble the entropy code of each 
codeblock into packets — > Generate codestream by 
arranging packets in desired order. 

The last two steps are so called codestream 

25 generation process. In the process, packets (units 
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of entropy coded code) are arranged in a desired 
order . 

The relation among image, tiles, subbands, 
precincts, codeblocks, packets, and layers are as 
follows (see FIG. 15) . The order of dimension is as 
follows : 

an image ^ a tile > a subband =5 a precinct 2^ a 
codeblock 

Tiles are rectangular divisions of an image. 
If the number of division equals to one, a tile 
equals to an image. 

Precincts are rectangular divisions of 
subbands and roughly express the position in the 
image. One unit of precinct is composed of 3 
rectangular division in HL, LH , and HH subbands, 
whose positions in the tile are the same thereamong. 
Or one unit of precinct is composed of only 1 
rectangular division in LL subband. A precinct can 
be as large as 3 (= HL, LH , HH) subbands (so called 
maximum precinct) . And precincts are further divided 
into rectangular codeblocks . 

A packet is a collection of a part of 
entropy code from each codeblock within one precinct. 



The above-mentioned "a part" can have some bitplanes 
(not all bitplanes) , or the above-mentioned "a part" 
can have even no bitplane. When "a part" from each 
codeblock includes no bitplane, the packet is called 
a n empty packet" . 

A layer is a collection of packets from each 
precinct (for the entire tile) . A layer is roughly a 
part of bitplanes for the entire tile, which mean 
units of the tile (image) quality. 

The collection of all layers forms the 
codestream for the entire tile. FIGS. 16A, 16B and 
16C. shows an example illustrating the layers and 
packets in case the number of decomposition levels 
(how many times wavelet transforms are done) is 2, 
and the maximum precinct is used. Since a packet is 
a collection throughout the precinct, when the 
maximum precinct is used, the packet is a collection 
throughout the HL, LH , and HH subbands Some packets 
are enclosed in bold lines as shown in FIGS. 16A, 16B 
and 16C. 

Accordingly* even after the codestream 
generation, the above-mentioned post-quantization can 
be done by discarding some layers (in case the 
codestream has multiple layers) , or some packets. Or 
it is possible to discard the entropy code of some 
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bitplanes included in the packet and generate a 
packet header again. 

A subband gain will now be described. 
During a decoding, an inverse wavelet transform is 
applied, and, there, the "magnif ication" between a 
wavelet coefficient and a pixel value is different 
for each subband. The square of this "magnification" 
is called a subband gain (Gsb) . During the inverse 
transform, a quantization error Ae is multiplied by 
V~ Gsb. 

A subband gain can be calculated bellow for 
5x3 wavelet transform, as an example: 

An inverse transform of 5x3 wavelet is done 
on interleaved coefficients. First, inverse lowpass 
filter is applied horizontally ( i . e . , along the x 
axis) on even coefficients C(2i), and P(2i) is 
calculated. A second inverse highpass filter is 
applied horizontally on odd coefficients C(2i + 1), and 
P(2i+1) is calculated. These processes are done for 
each vertical line (i.e., y coordinate). Here, 
inverse filters are defined as follows: 



P (2i) =C (2i) — L (C (2i-l) +C (2i + l) 4-2) /4J 
P (2i + l) =C (2i + l) +L (P (2i) +P (2i + 2) ) /2J 



Eq. 3 
Eq. 4 
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Removing the floor function {L J) from Eq.3 
and Eq.4 above, Eq.5 and Eq.6 below are given 
approximately : 



5 P(2i)=C(2i)— l/4-C(2i-l)-l/4"C(2i + l)— 1/2 

Eq. 5 

P(2i + l)=C(2i + l)+P(2i)/2 + P (2i+2) /2 
Eq. 6 

= — 1/8 ' C(2i-1) +1/2 ' C(2i) +3/4 ■ C(2i+1) +1/2 ■ 
10 C (2i + 2) —1/8 " C (2i + 3) — 1/2 

From Eq.5 and Eq.6, following 5 equations 

are given: 



P(2i-1)= — 1/8 " C(2i-3) +1/2 ■ C(2i-2) +3/4 ■ C(2i-1) 
15 +l/2"C(2i>— 1/8-C (2i + l) — 1/2 ; 

P(2i) =C(2i)— 1/4-C (2i-l) -1/4 - C (2i+l) —1/2; 
P (2i + l) = — 1/8 ■ C (2i-l) +1/2 ■ C(2i) + 3/4 ■ C (2i+l) + 
1/2 • C (2i+2) — 1/8 - C (2i + 3) —1/2; 

P (2i + 2) =C (2i + 2) — 1/4 ■ C (2i+l) — 1/4 " C (2i + 3) — 1/2 ; 
20 P(2i + 3)= — 1/8 ' C(2i + 1) +1/2 • C(2i + 2) +3/4 • C(2i + 3) 

+ l/2-C(2i + 4)— 1/8-C (2i + 5) -1/2 . 



If a highpass coefficient C(2i+1) has a unit 
quantization error, these 5 equations show that the 
25 error effects on 5 pixels. Assuming that these 
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effected errors are decorrelated , the root of sum of 
squared errors on 5 pixels is given as follows: 

<T [ (-1/8) 2 + (-1/4) 2 + (3/4) 2 + (-1/4) 2 + (-1/8) 2 ] 
5 =0.85 

This means that the unit error in high pass 
coefficient is transformed into the pixel value error 
of 0.85. This is the root of inverse highpass filter 
10 gain. 

Similarly, if a lowpass coefficient C(2i) 
has a unit quantization error, these 5 equations show 
that the error effects on 3 pixels and the root of 
sum of squared errors on 3 pixels is given as 
15 follows: 

V" [ (1/2) 2 + l 2 + (1/2) 2 ] =1.2 

This means that the unit error in lowpass 
20 coefficient is transformed into the pixel value error 
of 1.2. This is the root of inverse lowpass filter 
gain . . 

Additionally, when applying a 2-dimensional 
inverse wavelet transform, LL coefficients need the 
25 inverse transform twice (horizontally and vertically) 
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5 



Then, the unit error in LL coefficient is transformed 
into the error of 

1.2X1.2. 

This is the root of LL subband gain. 
Similarly, the unit error in HL or LH coefficient is 
transformed into the error of: 



10 1.2X0.85 

This is the root of HL and HL subband gain 
For example, the next tables show the root 

of each subband gain in case the number of 
15 decomposition levels is 5 . 

The values in these tables are used in 

calculation for the embodiments of the present 

invention described later. 



20 



25 
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SQUIRE ROOT OF SUBBAND GAIN IN 9 X 7 INVERSE 
TRANSFORM 









decomposition level 




5 


4 


3 


2 


1 


LL 


29.4 


14.9 


7.6 


3.9 


2.0 


HL 


15.1 


7.7 


3.9 


2.0 


1.0 


LH 


15.1 


7.7 


3.9 


2.0 


1.0 


HH 


7.8 


4.0 


2.0 


1.0 


0.5 



SQUIRE ROOT OF SUBBAND GAIN IN 5X3 INVERSE 
TRANSFORM 



l 








decomposition level 






5 


I 4 


3 


2 


1 


LL 


7.6 


5.1 


3.4 


2.3 


1.5 


HL 


5.3 


3.5 


2.3 


1.6 


1.0 


LH 


5.3 


3.5 


2.3 


1.6 


1.0 


HH 


3.6 


2.4 


1.6 


1.1 


0.7 



Furthermore the gain of inverse component 
transform are given similarly. These gains are the 
sums of squared errors in original (usually RGB) 
components caused by a unit error in the transformed 
component (usually YCbCr) domain. The squared error 
of inverse ICT ( irreversible component transform) gain 
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and inverse RCT ( reversible component transform) gain 
are shown in the following tables . 

SQUIRE ROOT IN INVERSE ICT 



Y 


1.7 


Cb 


1.8 


Cr 


1.6 



5 

SQUIRE ROOT IN INVERSE RCT 



Y 


1.7 


Cb 


0.8 


Cr 


0.8 



Additionally, the definition of component 
transforms are shown below: 
10 (1) Reversible component transform: 

Reversible component transform is called RCT 
(Reversible multiple component transform) , and has a 
characteristic in that coefficients in the formula 
are integers. The formulas thereof are shown below: 



15 
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Y 0 (x,y) = 



Io (x,y) + 2*Ii (x,y) + I 2 (x,y) 



Y 4 (x,y) - I 2 (x,y) - I (x,y) 



Y 2 (x,y) = I Q (x,y) - I, (x,y) 



I^y)- Y(x,y) 



Y (x,y) + Y (x,y) 



I o (x,y)= Y 2 (x,y) + I (x,y) 



I 2 (x,y)= Y(x,y) + I i (x,y) 



(2) Irreversible component, transform: 
Irreversible component transform is called 
ICT (Irreversible multiple component transform) , and 
has a characteristic in that coefficients in the 
formula are real numbers. The formulas thereof are 
shown below: 
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Y o (x,y) = 0.299*1 Q (x 5 y) + 0.587*^ (x,y) + 0.114*I 2 (x,y) 
Y(x,y) = -0.16875*I o (x,y) - 0.33126*^ (x,y) + 0.5*I 2 (x,y) 
Y 2 (x,y) = 0.5*I o (x,y) - 0.41869*^ (x,y) - 0.0813 1*I 2 (x,y) 

I 0 (x,y) = Y (x,y) + 1 .402*Y 2 (x,y) 

I ^x.y) = Y o (x,y) - 0.34413*Y I (x,y) - 0.71414*Y 2 (x,y) 
I 2 (x,y) = Y o (x,y) + 1.772*Y (x,y) 

In these formulas, in case where an original 
image has RGB components , I 0 corresponds to R ; II 
5 corresponds to G; 12 corresponds to B; Y0 corresponds 
to Y; Yl corresponds to Cb ; and Y2 corresponds to Cr . 

Next, an operation of the electronic camera 
apparatus of according to the present embodiment will 
be described (or an operation at a time of taking a 
10 still picture) . 

One example of an operation at the time of 
taking a still picture is described below with 
reference to a flow chart shown in FIG. 4. When a 
release button (not shown) included in the operation 
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part 124, that is a button for ordering taking a 
still picture, is pushed, an order for taking the 
still picture is given to the image processor 110 by 
the system controller 122 so that the image processor 
5 110 drives the image sensor 104 under conditions for 
taking a still picture. The image data of the still 
pictures are tile-divided for every respective 
component by the image processor 110 so as to be sent 
to the image compression/elongation part 150 to be 

10 compression-processed (STEP 100) . In the image 
compression/elongation part 150, a lossless 
compression is performed at the entropy coding part 
158. At the code generation part 160, a post- 
quantizing corresponding to an image quality mode 

15 such as a high image quality, a standard image 

quality, an economy image quality, or the like, is 
performed. The image quality is preset with the 
operation part 124. by an operator (a user) . In a 
case where the image quality mode is not preset, an 

20 image quality mode of default is selected and 

designated to the image compression/elongation part 
150 by the system controller 122 . It may be possible 
to not perform the post-quantization at the time of 
using the high image quality mode. The above 

25 mentioned example is included in the present 
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invention. 

At the time of the coding process, the 
management information storing part 164 obtains, for 
example, an amount of lossless code, an amount of 
5 code after post-quantized (amount of present code) , 
the total number of non-zero bitplanes, an image 
quality mode, an image size, and the like, as 
information for determining a remaining 
force (capability ) for reducing the amount of 
10 compressed image data, namely, information for 

determining the rank of a process for reducing the 
amount of compressed image data. The amount of 
lossless code and the amount of code after post- 
quantized can be obtained by the code generation part 
15 160. The amount of lossless code to which added 
visual weight is given for every sub-band and the 
amount of code after post-quantization may be 
obtained.. The above mentioned example is included in 
the present invention. The total number of the non- 
20 zero bitplanes can be calculated by subtracting the 

zero pit plane number obtained from the packet header 
of the code data from the total bitplane number. The 
total number of the non-zero bitplanes or the zero 
bitplane number may be obtained by the code 
25 generation part 160 and sent to the management 
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inf ormation storing part 164. The image size and 
image quality mode are designated by the system 
controller 122 and may be obtained from the main 
header of the code data. It is not necessary to 
5 obtain all of this information. Rather, only the 
part of the information that is necessary for 
determining the remaining force (capability) for 
reducing the amount of the image data may be obtained. 

The file managing part 166 records code data 

10 output by the image compression/elongation part 150 
to the recording medium 170 as an image file of 
JPEG2000 (STEP 102) . The file managing information 
on the management information storing part 164 is 
renewed after completing recording (STEP 104) . 

15 Information obtained at STEP 100 is included in the 
file managing information. A photographer can 
operate "designation of my favorite", "designation of 
allowance of monochrome-making", and "designation of 
allowance of size changing" for processing the image 

20 file that is recorded just after photographing or at 
a designated timing. This information is included in 
the file managing information. . Information recording 
the number of times of application of the reduction 
process of the amount of the data for the respective 

25 image files is also included the file managing 
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inf ormation . Furthermore, information recording the 
unused capacity of the recording medium 170 is also 
included in the file managing information. 
Furthermore, information recording the distinction of 
5 the image file of the still picture and the motion 
picture is also included in the file managing 
information . 

A specific storing area on the recording 
medium 170 is allocated to. the management information 

10 storing part 164. Because of the above mentioned 

structure, even in a case where the recording medium 
170 is exchanged, it is not necessary to reproduce 
the file managing information and reduction rank list 
regarding the image file on the recording medium 170. 

15 Furthermore, a copy of the file managing information 
and reduction rank list regarding the image file on 
the management information storing part 164 may be 
recorded on the recording medium 170. Because of the 
above mentioned structure, there is an advantage in 

20 that the file managing information and the reduction 
rank list can be reconstructed on the management 
information storing part 164 by only reading a copy . 
of the file managing information and the reduction 
rank list without referring to the image file of the 

25 recording medium 170 when the recording medium 170 is 
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exchanged . 

The data amount reduction managing part 162 
refers to specific information in file management 
information stored in the managing information 
5 storing part 164. The data amount reduction managing 
part 162 determines the data amount reduction 
remaining force of an image file added this time, 
under a specific determination criterion based on the 
above mentioned specific information so as to 

10 determine its data amount reduction rank. As a 
result of this, the reduction rank list on the 
management information storing part 164 is renewed 
(STEP T06) . This reduction rank list is a list for 
arranging indexes of all of the image files (or a 

15 higher ranked M n" number of image files that have a 
large data amount reduction remaining force) , 
according to the data amount reduction rank (order) . 
The data amount reduction rank is basically 
determined to give precedence to one having a large 

20 data amount reduction remaining force in terms of 
image quality. Examples of specific determination 
criteria for the data amount reduction remaining 
force are as follows . 



2 5 1. CRITERION 1: 
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An image file having a large value of "the 
amount of the present code / the amount of the 
lossless code" is given a priority. Since the above 
mentioned ratio represents a reduction degree of the 
5 amount of information at present time, the image file 
having a large value of the above mentioned ratio has 
a large data amount reduction remaining force. 

2. CRITERION 2: 

10 An image file having a large value of "the 

amount of the present code to which added visual 
weight is given every sub-band / the amount of the 
lossless code to which added visual weight is given 
every sub-band" is given a priority. This ratio is 

15 calculated by normalizing the denominator and 

numerator of the above mentioned criterion 1 so as to 
form an information amount that is effective visually. 

3 . CRITERION 3 : 

20 An image file having a large value of "the 

amount of the present code / the total number of the 
non-zero bitplanes" is given a priority. What "the 
total number of the non-zero bitplanes" is large 
means is that an absolute value of the wavelet 
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coefficients is large, namely that the amount of the 
lossless code is large . 

4. CRITERION 4: 
5 An image file having a large value of image 

size is given a priority. Since the image having a 
large size has high redundancy, little deterioration 
of the image quality will occur. 

10 5. CRITERION 5: 

An image having a small total amount of non 
zero bitplanes are given a priority. Since the image 
having small total amount of non-zero bitplanes has 
few high frequency components and a high possibility 

15 of photographic failure due to blurring, it is 

difficult to further cause a problem of deterioration 
of image quality due to data amount reduction. 

6. CRITERION 6: 

20 An image file having a small value of "sum 

of truncated bitplanes or sum of truncated 
subbitplanes" is given a priority. Since the above 
sum represents a sum of reduced bits from an original 
coefficients, the image file having a small value of 

25 the above mentioned sum has a large data amount 
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reduction remaining force. 

7. CRITERION 7: 

An image file having a small value of "sum 
5 of truncated bitplanes or sum of truncated 

subbitplanes which is determined considering the 
quantization step sizes." is given a priority. Since 
the above sum represents a sum of reduced bits from 
an original coefficients, the image file having a 
10 small value of the above mentioned sum has a large 
data amount reduction remaining force. 

8. CRITERION 8: 

An image file having a small value of "sum 
15 of truncated bitplanes or sum of truncated 

subbitplanes which is determined considering the 
subband gains" is given a priority. Since the above 
sum represents a sum of reduced bits from an original 
image in the spatial domain (after inverse frequency 
20 transform, for example, inverse wavelet transform) , 
the image file having a small value of the above 
mentioned sum has a large data amount reduction 
remaining force. 

25 9. CRITERION 9: 
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An image file having a small value of "sum 
of truncated bitplanes or sum of truncated 
subbitplanes which is determined considering the 
inverse component transform gains" is given a 
5 priority. Since the above sum represents a sum of 
reduced bits from an original components in the 
spatial domain (after inverse component transform, 
for example, inverse RCT) , the image file having a 
small value of the above mentioned sum has a large 
10 data amount reduction remaining force. 

10. CRITERION 10: 

An image file having a small value of "sum 
of truncated bitplanes or sum of truncated 

15 subbitplanes which is determined considering the 

human visual character" is given a priority. Since 
the above sum represents a sum of reduced bits in 
terms of human visual character, it represents the 
subjective degradation of the image quality. Then 

20 the image file having a small value of the above 
mentioned sum has a large data amount reduction 
remaining force . 



25 



11. CRITERION 11: 

An image file having a small value of "sum 
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of quantization error" is given a priority. Since 
the above sum represents a sum of difference between 
an original image and compressed image file, it 
represents the degradation of the compressed image 
5 file directly. Then the image file having a small 
value of the above mentioned sum has a large data 
amount reduction remaining force. 

12. CRITERION 12: 

10 An image file having a small value of "sum 

of quantization error considering the truncated 
bitplanes (or truncated subbitplanes ) and 
quantization step sizes" is given a priority. Since 
the above sum represents a sum of difference between 

15 an original coefficients and compressed coefficients, 
it represents the degradation of the compressed image 
file directly. Then the image file having a small 
value of the above mentioned sum has a large data 
amount reduction remaining force. 

20 

13. CRITERION 13: 

An image file having a small value of "sum 
of quantization error considering the subband gains" 
is given a priority. Since the above sum represents 
25 a sum of difference between an original image and 



compressed image in the spatial domain (after inverse 
frequency transform, for example, inverse wavelet 
transform ) , it represents the degradation of the 
compressed image file directly. Then the image file 
having a small value of the above mentioned sum has a 
large data amount reduction remaining force. 

14. CRITERION 14: 

An image file having a small value of "sum 
of quantization error considering the inverse 
component transform gains " is given a priority. 
Since the above sum represents a sum of difference 
between an original image and compressed image in the 
spatial domain (after inverse component transform, 
for example, inverse RCT) , it represents the 
degradation of the compressed image file directly. 
Then the image file having a small value of the above 
mentioned sum has a large data amount reduction 
remaining force. 

15. CRITERION 15: 

An image file having a small value of "sum 
of quantization error considering the human visual 
character" is given a priority. Since the above sum 
represents a sum of difference- between an original 
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image and compressed image in terms of human visual 
character, it represents the subjective degradation 
of the image quality. Then the image file having a 
small value of the above mentioned sum has a large 
5 data amount reduction remaining force. 

16. CRITERION 16: 

An image file photographed at a high image 
quality mode is given a priority. In a case of a 
10 high image quality, even if the data amount reduction 
is performed, the image file can maintain good image 
quality . 

17. CRITERION 17: 

15 An image file having a small number of times 

of an application of the data amount reduction 
process is given to a priority. The image file 
having a small number of times of the application of 
the data amount reduction process generally has 

20 better image quality than an image file having a 

large number of times of the application of the data 
amount reduction process. 

18. CRITERION 18: 



An image file of a motion picture is given a 
higher priority than an image file of a still picture. 
A motion picture is not required to have as high an 
image quality as a still picture, 

19. CRITERION 19: 

In image files of motion pictures, an image 
file of a motion picture having a larger average 
value or maximum value of the ratio of the criterion 
(1) or (3) is given a priority. 

20. CRITERION 20: 

In frames in motion pictures, a frame having 
a larger ratio of the criterion (1) , (2) , or (3) is 
given a priority. 

The above mentioned criteria are 
determination criteria in terms of image quality. In 
this embodiment, the following criteria can be 
applied . 

21. CRITERION 21: 

An image file to which "size change 
allowance designation" or "monochrome-making 
allowance designation" is designated by the 
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photographer is given a priority. This criterion is 
based on the will of the photographer. In the files 
having these designations, the photographer allows 
the data amount reduction and designates its method. 
5 Since an image film having ''designation of my 

favorite" of the photographer is a file in which the 
photographer desires to prevent the deterioration of 
image quality, namely to which protection is 
designated, the image film having "designation of my 
10 favorite" of the photographer is not a subject to 
data amount reduction. 

22 . CRITERION 22 : 

An image file having an old date (the 

15 recording data of the image file) is recorded is 
given a priority. This criterion is based on the 
elapsed time since recording. This is because, 
generally, an old image is given "designation of my 
favorite" if the image is important to the 

20 photographer or is to be copied to another recording 
medium . 

Based on the above descriptions, "sum of 
non-zero bitplanes", mentioned above to be applied to 
the embodiment of the present invention, can be given 
25 as follows, for example. "Sum of non-zero bitplanes" 
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represents the total number of bits to be actually 
coded; it represents the amount of data included in 
the original image. Then, "original coded length/sum 
of non-zero bitplanes" can be used as a criterion. 

Using the notations below: 

Number of maximum bitplanes: MBP ; 

Number of zero bitplane in the codeblock: ZBP; and 

Number of coefficients in the codeblock: N. 

Then, "sum of non-zero bitplanes" can be 
calculated as follows: 

Z Z Z { (mbp — ZBP) X n} 

(for component) (for subband) (for codeblock) 

Exactly, this equation means the summation of 
[('number of maximum bitplanes' - x number of zero 
bitplane in the codeblock') X ^number of coefficients 
in the codeblock'] 

for all codeblocks, all subbands, and all components. 

That is to say, this equation calculates the 
"summation of non-zero bits for all wavelet 
coefficients". Then, it might be better to call as 
"sum of non-zero bits" rather than "sum of non-zero 
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bitplanes " . 

Similarly, "sum of truncated subbitplanes " , 
mentioned above to be applied to the embodiment of 
the present invention, can be given as follows, for 
5 example: 

Using the notations below: 

Number of non-zero subbitplane in the codeblock: 
NZSBP; 

10 Number of coded subbitplanes in the codeblock: CSBP; 
and 

Number of coefficients in the codeblock: N. 

"Sum of truncated subbitplanes (might better 
15 to call as subbits) " can be calculated as: 

Z Z Z { (nzsbp — csbp) xn} 

(for component) (for subband) (for codeblock) 

20 Similarly, this equation means the summation 

of: 

[('number of no-zero subbitplanes' - 'number of coded 
subbitplane in the codeblock') x 'number of 
coefficients in the codeblock'] 
25 for all codeblocks, all subbands , and all components. 
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Similarly, "sum of truncated bitplanes" can 
be given as follows, for example: 

Using the notations below: 
Number of non-zero bitplane in the codeblock: NZBP; 
5 Number of coded bitplanes in the codeblock: CBP ; and 
Number of coefficients in the codeblock: N. 

"Sum of truncated bitplanes (might be better 
to call as bits)" can be calculated as: 

10 Z Z Z { (nzbp— CBP) xn| 

(for component) (for subband) (for codeblock) 

Similarly, this equation means the summation 

of: 

15 

[ ('number of no-zero bitplanes' - 'number of coded 
bitplane in the codeblock') X "number of coefficients 
in the codeblock'] 

for all codeblocks, all subbands, and all components. 
20 As mentioned above, since the number of 

subbitplanes is approximately 3 times of the number 
of bitplanes, the simple equation is used here: 



CBP = ceil (CSBP/3) 

25 
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where 'ceil' means the rounding towards the equal or 
larger integer. 

In case of application of linear 
5 quantization, 'sum of truncated bitplanes in 

consideration of quantization step size' may also be 
calculated for example, in consideration of linear 
quantization further than the above-mentioned 
truncated subbi tplanes , as follows: 
10 Using the notations below: 

Number of non-zero subbitplane in the codeblock: 
NZSBP ; 

Number of coded subbitplanes in the codeblock: CSBP ; 

Quantization step size for a subband including the 
15 codeblock: Q; 

Number of truncated subbitplanes for the codeblock: 

TSBP (in this case, the truncation includes a 

truncation made according to the linear 

quantization) ; and 
20 Number of coefficients in the codeblock: N. 

"Sum of truncated bitplanes (might be better 

to call as bits)" can be calculated as: 



25 



Z Z Z (tsbpxn) 

(for component) (for subband) (for codeblock) 
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where QSBP = 31og 2 Q; and TSBP=NZSBP-CSBP-QSBP . 

This is because, quantization on 
coefficients with the quantization step size Q 
corresponds to a truncation of log 2 Q bitplanes , i.e., 
5 a truncation of 31og 2 Q subbitplanes . Also in the case 
of 5x3, this formula can be applied with an 
application of Q = 1. 

This 'sum of truncated subbitplanes in 
consideration of quantization step size' in which 
10 linear quantization is considered may also be 

regarded as an index which directly indicates the 
amount of data already reduced from the original data. 

Similarly, "sum of truncated bitplanes' is 
calculated further in consideration of linear 
15 quantization, as follows: 

Using the notations below: 
Number of non-zero subbitplane in the codeblock: 
NZBP; 

Number of coded bitplanes in the codeblock: CBP ; 
20 Quantization step size for a subband including the 
codeblock: Q; 

Number of truncated bitplanes for the codeblock: TBP 
(in this case, the truncation includes a truncation 
made in the linear quantization) ; and 
25 Number of coefficients in the codeblock: N. 
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Then, the following calculation is made: 

Z Z Z (tbpxnI 

(for component) (for subband) (for codeblock) 

5 

where QBP = 31og 2 Q; and TBP=NZBP-CBP-QBP . 

This is because, quantization on 
coefficients with the quantization step size Q 
corresponds to a truncation of log2<2 bitplanes. Also 

10 in the case of 5x3 wavelet transform, this formula 
can be applied with Q = 1. 

This 'sum of truncated bitplanes in 
consideration of quantization step size' in which 
linear quantization is considered may also be 

15 regarded as the index which directly indicates the 

amount of data already reduced from the original data, 
to be applied to the embodiment of the present 
invention for selecting an image data unit to be 
erased for creating an unused capacity. 

20 Furthermore, as described above, the V G sb is 

multiplied when the coefficients are returned to RGB 
values in the wavelet inverse transform. This means 
that the number of truncated subbitplanes is 
increased by 31og 2 VGsb. In terms of bitplanes, the 

25 number thereof increases by log 2 VGsb. Even without 
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cons ideration of the Gsb, the resulting value can be 
used as the index of reduced data for the purpose of 
a comparison to be made between codes on a common 
decomposition level, for example. However, the value 
5 of Gsb differs according to the subband. Accordingly, 
it is possible to obtain the index of reduced data 
amount which is more generalized one by the 
consideration thereof . 

Accordingly, according to the embodiment of 

10 the present invention, the subband gain may be 

considered further than the above-mentioned number of 
truncated subbitplanes . Thus, 'sum of truncated 
subbitplanes in consideration of subband gain' may be 
calculated as follows: 

15 Using the notations below: 

Number of non-zero subbitplane in the codeblock: 
NZSBP; 

Number of coded subbitplanes in the codeblock: CSBP ; 
Quantization step size for a subband including the 
20 codeblock: Q ; 

Subband gain on the subband including the codeblock: 
Gsb ; 

Number of truncated subbitplanes for the codeblock: 
TSBP (in this case, the truncation includes a 
25 truncation made in the linear quantization) ; and 



-57- 



Number of coefficients in the codeblock: N. 

Z Z Z {tsbpxn} 

(for component) (for subband) (for codeblock) 

5 

where QSBP = 31og 2 Q; GSBP = 31og 2 VGsb ; and TSBP=NZSBP 
CSBP-QSBP-GSPB . 

Also in case of 5x3 wavelet transform, this 
formula can be applied with Q = 1 . 
10 Similarly, 'sum of truncated bitplanes ' may 

be calculated further in consideration of linear 
quantization, as follows: 

Using the notations below: 
Number of non-zero subbitplane in the codeblock: 
15 NZBP; 

Number of coded bitplanes in the codeblock: CBP; 
Subband gain on the subband including the codeblock 
Gsb ; 

Quantization step size for a subband including the 
20 codeblock: Q; 

Number of truncated bitplanes for the codeblock: TBP 
(in this case, the truncation includes a truncation 

made in the linear quantization) ; and 

Number of coefficients in the codeblock: N. 
25 Then, 
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Z Z Z (tbpxn) 

(for component) (for subband) (for codeblock) 

where QBP = log 2 Q; GBP=log 2 VGsb ; and TBP=NZBP-CBP-QBP- 
5 GBP . 

Also in case of 5x3, this formula can be 
applied with Q = 1 . 

It is well known that the human vision is 
more sensitive on a low frequency than on high 

10 frequency in image. As a result, a human is more 

sensitive on the quantization errors in low frequency 
subbands than on those in high frequency subbands . 
This means that it is desirable to select large 
quantization step sizes for high frequency subbands 

15 and small step sizes for low frequency subbands in 

terms of transform efficiency. That is to say, it is 
desirable to truncate many bitplanes for high 
frequency subbands and a few bitplanes for low 
frequency subbands . 

20 Reflecting the above human vision character, 

the JPEG2000 standard discloses the amount called 
"Visual Weight" , which represents the visual 
importance for each subband 1 s coefficient. "Visual 
Weight" is a function of viewing distance, and the 

25 standard discloses some kind of weight tables. 
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Examples of the tables are shown below, and larger 
the weight value is, the more important visually the 
subband is. The standard says that the typical way 
of applying this weight is to divide the typical 
5 quantization step size for the subband by the weight 
for the relevant subband. Then a visually optimized 
quantization step size is given. 
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In terms of truncation, if we apply these 
weights for the number of truncated subbitplanes of 
each subband, we can get more appropriate criterion 
for the amount of reduced data. Since dividing the 
5 step sizes by the weight W corresponds to multiplying 
W to the coefficients, it is equal to truncate the 
subbitplanes less by the amount of 31og 2 W. 

Accordingly, when the above-mentioned 
subband gain and also this visual weight are 

10 considered for the above-mentioned number of 
truncated subbitplanes, 'sum of truncated 
subbitplanes in consideration of subband gain and 
visual weight' is obtained, as follows, according to 
the embodiment of the present invention: 

15 Using the notations below: 

Number of non-zero subbitplane in the codeblock: 
NZSBP ; 

Number of coded subbitplanes in the codeblock: CSBP; 
Quantization step size for a subband including the 
20 codeblock: Q; 

Subband gain on the subband including the codeblock: 
Gsb ; 

Visual Weight on the subband including the codeblock: 
W; 

25 Number of truncated subbitplanes for the codeblock: 
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TSBP (in this case, the truncation includes a 
truncation made in the linear quantization) ; and 
Number of coefficients in the codeblock : N. 

5 Z Z Z (tsbpxn) 

(for component) (for subband) (for codeblock) 

where QSBP = 31og 2 Q; GSBP=31og 2 ^Gsb ; WSBP=31og 2 W; and 

TSBP=NZSBP-CSBP-QSBP-GSPB+WSBP . 
10 Also in the case of 5x3, this formula can be 

applied with Q = 1. 

Similarly, 'sum of truncated bitplanes ' is 

calculated further in consideration of linear 

quantization, as follows: 
15 Using the notations below: 

Number of non-zero subbitplane in the codeblock: 

NZBP ; 

Number of coded bitplanes in the codeblock: CBP ; 
Subband gain on the subband including the codeblock: 
20 Gsb; 

Visual Weight on the subband including the codeblock: 
W; 

Quantization step size for a subband including the 
codeblock: Q; 

25 Number of truncated bitplanes for the codeblock: TBP 



(in this case, the truncation includes a truncation 
made according to the linear quantization) ; and 
Number of coefficients in the codeblock : N. 
Then , 

Z Z Z (tbpxn) 

(for component) (for subband) (for codeblock) 

where QBP = log 2 Q; GBP=log 2 VGsb ; WBP=log 2 W; and 
TBP=NZBP-CBP-QBP-GBP+WBP . 

Also in case of 5x3, this formula can be 
applied with Q = 1. 

The above-mentioned described manner applies 
the number of truncated subbitplanes as the index 
applied for selecting an image data unit to be erased 
for creating an unused capacity, and, thus, in other 
words, it applies the quantization error as the index. 
This is because a truncation of n bitplanes is 
equivalent to a linear quantization with a 
equalization step size (= 2 n ) , and an average 
quantization error occurring in this case is a half 
the quantization step size, i.e., 2 n_1 . Similarly, a 
truncation of n subbitplanes is equivalent to a 
linear quantization with a quantization step size (= 
2 n/3 ) , and an average quantization error occurring in 
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this case is a half the quantization step size, i.e., 
2 n/3_1 . Then, by further considering the above- 
mentioned visual weight, a further generalized index 
of the already reduced data which reflects the visual 
5 characteristics can be obtained. 

Accordingly, according to the embodiment of 
the present invention, 'sum of visual errors in 
consideration of subband gain and visual weight' may 
be calculated as follows: 
10 Using the notations below: 

Number of non-zero subbitplane in the codeblock: 
NZSBP; 

Number of coded subbitplanes in the codeblock: CSBP; 
Quantization step size for a subband including the 
15 codeblock: Q; 

Subband gain on the subband including the codeblock: 
Gsb ; 

Visual Weight on the subband including the codeblock: 
W; 

20 Number of truncated subbitplanes for the codeblock: 

TSBP (in this case, the truncation does not include a 
truncation made according to the linear 
quantization) ; and 

Number of coefficients in the codeblock: N. 

25 
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Z Z Z {2 TSBP/3 - x xV(Gsb) / (Q/W)x N } 

(for component) (for subband) (for codeblock) 

where TSBP=NZSBP-CSBP . 
5 Also in case of 5x3, this formula can be 

applied with Q = 1 . 

The sum of errors may instead be obtained in 
a form of sum of squares, as follows: 

10 Z Z Z {2 2TSBP/3 " 2 xGsb/ (Q/W) 2 xn} 

(for component) (for subband) (for codeblock) 

where TSBP=NZSBP-CSBP . 

Similarly, another 'sum of visual errors in 
15 consideration of subband gain and visual weight' may 
be obtained as follows: 

Using the notations below: 
Number of non-zero bitplane in the codeblock: NZBP; 
Number of coded bitplanes in the codeblock: CBP ; 
20 Subband gain on the subband including the codeblock: 
Gsb; 

Visual Weight on the subband including the codeblock: 
W; 

Quantization step size for a subband including the 
25 codeblock: Q; 
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Number of truncated bitplanes for the codeblock: TBP 
(in this case, the truncation does not include a 
truncation made according to the linear 
quantization) ; and 
5 Number of coefficients in the codeblock: N. 
Then, 

Z Z Z {2 TBP ^xV(Gsb) / (Q/W)x N J 

(for component) (for subband) (for codeblock) 

where TBP=NZBP-CBP . 

Also in case of 5x3, this formula can be 
applied with Q =. 1. 

The sum of errors may instead be obtained in 
a form of sum of squares, as follows: 

Z Z Z {2 2TBP " 2 xGsb/ (Q/W) 2 x N } 

(for component) (for subband) (for codeblock) 

20 where TBP=NZBP-CBP . 

As described above, in case of applying 
color transform among components, other than the 
above-mentioned Gsb, Get which is a gain on an 
inverse component transform may be considered for 

25 each component. In this case, instead of Gsb, (Gsb x 



10 



15 
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Gct) may be used. Furthermore, as the visual weight 
for 5x3, the same for 9 x 7 is modified in a manner 
that the values of Cb and Cr are halved may be used. 

Furthermore, in order that the visual weight 
5 is reflected for each subband with respect to the 

above-mentioned amount of present code and amount of 
lossless code, the following manner may be applied: 

Amount of lossless code on the subband: LSLEN; 
10 Amount of present code on the subband: CURLEN; and 
Visual weight on the subband: W. 

Then, an example of the amount of lossless 
code considering the visual characteristics is 
15 obtained as follows: 

Z Z (LSLEN x W) 

(for component) (for subband) 

20 An example of the amount of present 

invention code amount considering the visual 
characteristics is obtained as follows: 



25 



Z Z (CURLEN x w) 

(for component) (for subband) 



The photographer can designate any number of 
the above mentioned criteria. This designation is 
done by selecting sole criterion or a combination of 
criteria from a menu displayed at the displaying 
apparatus 112. In a case where a combination of the 
criteria is designated, respective criteria are 
applied in a designated order. In a case where the 
photographer does not designate , pre-designated one 
or more criteria are applied. In a case where the 
criterion 10 is not designated, the ranks of the 
respective frames in the motion picture are 
equivalent. 

Referring back to FIG. 4, it is possible to 
set an automatic action mode for the data amount 
reduction process . In a case where the automatic 
action mode is not set (STEP 108 , No), the system 
controller 122 completes the process of the operation. 

In a case where the automatic action mode 
for the data amount reduction process is set (STEP 
108, Yes), the system controller 122 switches to the 
control of the data amount reduction process (STEP 
110) . 

One example of the automatic reduction 
process at STEP 110 is explained with reference to 
the flow chart of FIG. 5. The system controller 122 
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refers to the file management information and 
determines whether the recording medium 170 has an 
unused capacity greater than designated capacity 
(STEP 120) . If the recording medium 140 has a 
5 sufficient unused capacity (STEP 120 Yes) , the 
process is ended. 

In a case where there is a lack of the 
unused capacity (STEP 120, No), the system controller 
122 makes the data amount reduction management part 

10 162 start the process for reducing the data amount. 
At first, the data amount reduction management part 
162 selects an image file that is highest ranked at 
the reduction rank list and refers to its file 
managing information (STEP 122), and determines 

15 whether or not the image file has "size change 
allowance designation" or "monochrome-making 
allowance designation" (STEP 124) . 

In a case where the image file does not have 
either of the above mentioned designations, the data 

20 amount reduction management part 162 goes on to the 

process of STEP 126. In this step , the image file is 
read out by the file managing part 166 and code data 
of the image file are transmitted to the code 
generation part 160 of the image 

25 compression/elongation part 150. The code generation 
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part 160 performs a decomposition process on the data 
so as to decompose a code of low ranked sub-bitplane 
of one constant of the highest resolution degree in 
codes of packets. A former image file on the 
5 recording medium 170 is rewritten as an image file 
formed by the code data that have already been 
processed, at the file managing part 166. Related 
to this rewriting, the file managing information such 
as the amount of present code or the number of times 

10 of performing a data amount reduction process, is 

renewed. In a case where the code data of the image 
file forms plural layers, it is possible to delete 
the lower layer. The above mentioned example is 
included in the present invention. 

15 In a case where the image file that is 

selected has "size change allowance designation", the 
data amount reduction management part 162 goes on to 
STEP 128. In this step, the image file is read out 
by the file managing part 166 and code data of the 

20 image file is transmitted to the code generation part 
160 of the image compression/elongation part 150. 
The code generation part 160 performs a decomposition 
process so as to destruct a code of the highest 
resolution degree level of the data. A former image 

25 file on the recording medium 170 is rewritten as an 
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image file formed by the code data that have already 
been processed, at the file managing part 166. The 
file managing information is renewed. 

In a case where the selected image file has 
5 "monochrome-making allowance- designation", the data 
amount reduction management part 162 goes on to the 
process of STEP 130. In STEP 130,. the image file is 
read out by the file managing part 166 and code data 
of the image file are transmitted to the code 

10 generation part 160 of the image 

compression/elongation part 150. The code generation 
part 160 performs decomposition process so as to 
destruct codes of color differences Cr and Cb of the 
data. The former image file on the recording medium 

15 170 is rewritten as an image file formed by the code 
data that have already been processed, at the file 
managing part 166. The file managing information is 
renewed . 

Next, the data amount reduction managing 
20 part 162 performs a necessary process for determining 
a rank with reference to renewed file managing 
information so as to renew the reduction rank list 
(STEP 132) . The image file having "making-monochrome 
allowance designation" or "size change allowance 
25 designation" is made out of a subject to the data 
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amount reduction process, after the data amount 
reduction process is performed one time. The image 
file having both of the designations is made out of 
the subject to the data amount reduction process, 
5 when the number of times of application of the data 
amount reduction process reaches the designated 
number, for example, there is only a code of the sub- 
bitplane of the upper ranked number bit having the 
highest analysis degree level . 

10 It is possible to apply the data amount 

reduction process to the image file having "size 
change allowance designation" plural times. The 
above mentioned example is included in the present 
invention. It is also possible to apply the image 

15 file having "making-monochrome allowance designation" 
to the data amount reduction process substantially 
the same as the process for the image file having 
"non-designation", after making-monochrome is 
performed. The above mentioned example is included 

20 in the present invention. If tile division has 

already been performed on the image file having "size 
change allowance designation", it is also possible to 
perform the data amount reduction process by 
decomposing codes of some tiles. The above mentioned 

25 example is included in the present invention. 
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After the reduction rank list is renewed, 
the system controller 122 rechecks the unused 
capacity of the recording medium 170 (STEP 120) . If 
there is a lack of the unused capacity (STEP 120, No), 
5 a process subsequent to the STEP 122 is made to be 
performed by the system controller 122. 

At any timing, it is possible to order the 
performing of an automatic reduction process using 
the operation part 124. After the order is input, 

10 the system controller 122 starts the data amount 
reduction process as shown in FIG. 5. 

The greatest concern in a case where the 
data amount reduction process is performed on the 
recorded image data is whether or not the 

15 photographer (user) can accept deterioration of the 

image quality. In the present invention, as shown as 
the criteria (l)-(9), the data amount reduction 
remaining force of the image data is determined in 
terms of the image quality and the image data having 

20 a larger data amount reduction remaining force being 
given a priority and selected so as to perform the 
data amount reduction process. Hence, it is 
difficult to have dissatisfaction of the photographer 
regarding the deterioration of image quality due to 

25 the data amount reduction. Furthermore, the criteria 
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(11) and (12) are criteria made by considering the 
will of the photographer and any criteria can be 
selected and applied from plural criteria. Hence, it 
is possible to reflect the taste and will of the 
5 photographer in the selection of the image data on 

which the data amount reduction process is performed. 
For example, it is possible to obtain higher 
satisfaction of the photographer as compared with a 
case where image data having a large file size is 

10 simply selected so as to perform the data amount 

reduction process. Furthermore, it is not necessary 
for the photographer to directly select the image 
data to which the data amount reduction process is 
performed. As a result of this, usefulness of the 

15 electronic camera apparatus can be improved. 

[Operation at the time when the motion picture is 
taken] 

One example of an operation at the time of 
taking a motion picture is described below with 

20 reference to a flow chart shown in FIG. 6. When a 
button for ordering the taking of a motion picture 
(not shown) included in the operation part 124 is 
pushed, an order for taking a motion picture is given 
to the image processor 110 by the system controller 

25 122 so that the image processor 110 drives the image 



sensor 104 under conditions for taking a motion 
picture. The image data of the respective frames of 
the photographed motion picture are compressed by the 
substantially same steps as STEPs 100-104 as shown in 
FIG. 4 and recorded to the recording medium 170 so 
that the file managing information is renewed. 
Furthermore, the reduction rank list is renewed as 
well, as in STEP 106 shown in FIG. 4 (STEP 202). The 
image data of the motion picture are recorded as the 
image file having a file format of Motion JPEG2000. 

The system controller 122 refers to the file 
managing information every frame and determines the 
unused capacity of the recording medium 170. If the 
lack of the unused capacity of the recording medium 
170 can be assumed (STEP 204, Yes), the system 
controller 122 designates a compression ration having 
one step higher than the compression ratio that is 
set at present at the image compression/elongation 
part 150 (STEP 206) . The system controller 122 also 
makes the data amount reduction management part 162 
perform the data amount reduction process (STEP 208) . 
Although the process of STEP 208 is substantially the 
same as the process shown in FIG. .5, the unused 
capacity is not determined in STEP 208, unlike STEP 
120. In STEP 208, the data amount reduction process 
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is performed on a designated number of on image files 
that are upper-ranked in the reduction rank list. 

Thus, if there is concern about the lack of 
the unused capacity of the recording medium 170, the 
5 amount of data of the frame image newly recorded is 
reduced by raising the compression ratio, and the 
amount of the data of the image files that are 
already recorded is reduced, so that it is possible 
to avoid a state wherein recording cannot be 

10 performed during taking a motion picture due to the 
lack of the unused capacity. It may be possible to 
only reduce the amount of the data of the image file 
already recorded without changing the compression 
ratio. The above mentioned example is included in 

15 the present invention. 

[Data amount reduction process by the photographer] 

It is possible to select a mode of the data 
amount reduction process to which the photographer 
commits by using the operation part 124. An example 

20 of its operation will be described with reference to 
a flow chart shown in FIG. 7. 

If this mode is selected, the system 
controller 122 refers to the file managing 
information. The system controller 122 calculates 

25 the number of pieces that can be photographed and 



-76- 



assumed based on the unused capacity of the recording 
medium 170. The system processor 122 sends 
information indicating the number of the pieces to 
the image processor 110 with guidance information for 
5 designating the data amount reduction method and 

makes the displaying apparatus 112 to display. The 
photographer selects either "'size change allowance 
designation" , "making-monochrome allowance 
designation", "no-designation", or "end" (STEP 300). 

10 If the "size change allowance designation" or data 

amount reduction process for the image file to which 
the "size change allowance designation" is performed 
is desired to be performed in advance, the 
photographer selects the "size change allowance 

15 designation". If data amount reduction process for 
the image file to which the "size change allowance 
designation" is not performed is desired to be 
performed, the photographer selects "no-designation". 
If an end of the process is desired, the photographer 

20 can select "end". 

If a designation other than "end" is 
selected by the photographer, the- system controller 
122 refers to the reduction rank list and 
investigates "designation" information of its file 

25 managing information based on an upper ranked image 
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file. The system controller 122 finds the image file 
having the "designation" information selected by the 
photographer, so as to make the file managing part 
166 read out the image file and sends its code data 
5 to the image compression/elongation part 150. As a 
result of this, image data having the lowest analysis 
degree level are reconstructed. The system 
controller 122 makes the image processor 110 scale- 
down-indicate the image data to the displaying 

10 apparatus 112 so as to determine from the 

photographer whether or not the data amount reduction 
process is to be performed (STEP 306) . That is, a 
scaled-down-image of the image file having the 
designation selected by the photographer is displayed 

15 so that the photographer can determine whether or not 

the data amount reduction process should be performed. 

If the photographer orders the performance 
of the data amount reduction process by the operation 
part 124 (STEP 308, Yes), the system controller 122 

20 makes the data amount reduction managing part 162 
perform the data amount reduction process for the 
image file (STEP 310) . Process contents of this step 
are substantially the same as the processes of STEPs 
124-130. However, in this stage, a renewal process 
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of the reduction rank list, corresponding to STEP 132 
shown in FIG. 5, is not to be performed. 

After this process is ended, the system 
controller 122 goes back to STEP 300. In the process 
5 of the next iteration of STEP 306, an image file 

whose reduction rank is later than the scaled-down- 
image file indicated last time is selected and its 
scaled-down-image is indicated. 

If the photographer determines that 

10 recording medium 140 has a sufficient unused capacity 
based on the pieces applicable to be photographed, 
the photographer can order "end" at STEP 300. If 
"end" order is input (STEP 304, Yes), the system 
controller 12 makes the data amount reduction 

15 management part 162 perform a renewal process of the 
reduction rank list (STEP 312) . This renewal process 
is substantially the same as STEP 132 shown in FIG. 5 
[Various designation performances] 

As described above, it is possible to 

20 perform "designation of my favorite", "size change 
allowance designation", or "making-monochrome 
allowance designation" for the image file that has 
already been recorded at the time of just after 
photographing or at any timing. An example of the 
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operation for the designation will be described with 
reference to a flow chart shown in FIG. 8. 

If the photographer selects the operation 
mode by using the operation part 124, the system 
5 controller 122 refers to the file managing 

information and selects one image file not having 
"designation" from the side of a new recording date 
(or the side of an old recording date) . The system 
controller 122 makes the file managing part 166 read 

10 out the selected image file and makes the image 

compression/elongation part 150 use the elongation 
process for code data so that an image having the 
lowest analysis degree level can be reconstructed. 
The system controller 122 makes the image processor 

15 110 provides a scaled-down-image to the displaying 

apparatus 112 so as to encourage a designation input 
from the photographer (STEP 400) . In the case of a 
motion picture, for example, an image file of a first 
frame is selected and its image is scaled-down. 

20 The photographer can select "designation of 

my favorite", "size change allowance designation", 
"making— monochrome allowance designation" , "no- 
designation" or "end" by using the operation part 124 
In a case where "designation of my favorite" 

25 "size change allowance designation", or "making- 
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monochrome allowance designation" is selected (STEP 
402, Yes), the system controller 122 sets information 
mentioning its designation contents to the file 
managing information of the image file (STEP 404). 
5 In a case where the image file is a motion picture, 
information mentioning the same designation contents 
is set to the all of the frames. 

The system controller 122 goes back to STEP 
400. The system controller 122 selects one of the 

10 image files not having a designation and whose 

recording date is new (or old) following the image 
file selected the last time so as to provide its 
scale-down-image. The system controller 122 waits 
for a designation input by the photographer and 

15 performs a process corresponding to the designation 

input. Until "end" is input by the photographer, the 
substantially same processes are repeated. If the 
"end" is input by the photographer (STEP 406, Yes) , 
the system controller 122 makes the data amount 

20 reduction management part 162 perform the renewal 

process, of the reduction rank list (STEP 408) so as 
to end the operation. 

In the above mentioned embodiment, as means 
for performing the data amount reduction process for 

25 an image file that has already been recorded, the 
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code generation part 160 of the image 
compression/elongation part 150 is applied. Such 
means may be independent. 

Furthermore, in the above mentioned 
5 embodiment, an image compression algorithm in 
conformity to JPEG2000 is applied as the image 
compression algorithm. Hence, the data amount 
reduction process for the recorded image file is 
performed by deleting a part of the compressed code 

10 data. This method has an advantage in that there is 
little deterioration of the image quality as compared 
with a method by which the code data are elongated 
and then recompressed . However, it is possible to 
apply a method by which the data reduction is 

15 performed with recompression. This example is 
included in the present invention. 

Furthermore, all or a part of the system 
controller 122, the image compression/elongation part 
150, the file managing part 166 or the data amount 

20 reduction management part 162 may be performed by a 
single or plural processor (s) such as CPU(s) or 
MPU(s) with software. In other word, a process 
described with reference to respective flow charts of 
FIGS. 4-8 may be performed by software. The 

25 substantially same processes may be performed on an 
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all-purpose processor such as a computer by software. 
Furthermore, a program for the above mentioned 
performance and various kinds of recording media in 
which the program is recorded are included in the 
present invention . 

Thus, as described above, according to the 
present invention, in the electronic camera apparatus 
and other image recording apparatuses , the recorded 
image data are properly selected and the data amount 
reduction process is performed, so that the unused 
capacity of the recording medium can be secured and 
the user can obtain high satisfaction. Furthermore, 
since an operation for the data amount reduction 
including the selection of the image data can be 
automated, it is possible to improve the easiness of 
use and usefulness of an image recording apparatus 
such as an electronic camera apparatus. Furthermore, 
even if there is not sufficient margin of the unused 
capacity of the recording medium, it is possible to 
avoid an interruption of taking of the motion 
pictures due to the lack of the unused capacity. 

The present invention is not limited to 
these embodiments, but variations and modifications 
may be made without departing from the scope of the 
present invention . 
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This patent application is based on Japanese 
priority patent application No. 2001-213560 filed on 
July 23, 2002, the entire contents of which are 
hereby incorporated by reference. 



